In the Claims: 



Please amend the claims as follows: 

1 . (currently amended) A system that enables a user to interact with a virtual control 
panel using a user controlled pointing object, wh e rein the system comprises comprising: 

a first tracking unit (15b) adapted to capture data representing the position of the pointing 
object, charact e riz e d in that th e syst e m furth e r compris es : 

a portable identification element (3), 

a second tracking unit (15a) adapted to capture data representing the position of the 
identification element, 

a storage unit (29)? storing at least one pre-defined graphical interface representing a 
control panel of a device, said graphical interface comprising an interface for user interactions 
with the device, 

a graphics unit generating a graphical representation of the control panel based on 
said stored graphical interface, 

a registering unit (25), registering said graphical representation of the control panel in a 
fixed relation to said portable identification element, based on said data representing the position 
of the identification element, to produce a virtual control panel, 

a display unit fT)^ showing the user a view comprising the real world and the virtual 
control panel projected in a fixed relation to said portable identification element, and 

an application unit (24^ performing actions in response to the users interactions with the 
virtual control panel, and determining which actions to be performed based on the position of 
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said user controlled pointing object in relation to the identification element. 

2. (currently amended) A The system according to claim 1 , characteriz e d in that wherein 
the system is adapted to modify the appearance of the virtual control panel in response to 
interactions between the user controlled pointing object and the virtual control panel. 

3. (currently amended) A The system according to claim 1 or 2. characterized in that 
claim 1 . wherein said graphical interface is adapted to display data from the device and that 
wherein the system is adapted to generate a graphical representation of the data and to display 
the data on the virtual control panel. 

4. (currently amended) A The system according to any of th e pr e vious claims, 
charact e riz e d in that claim 1 , wherein said user controlled pointing object is a handheld pointing 
device (1) or a part of the user's body. 

5. (currently amended) A The system according to any of th e previous claims, 
charact e rized in that claim 1 . wherein the storage xmit (39) is adapted to store a plurality of 
graphical interfaces, each representing a control panel of a particular device, that wherein the 
system is adapted to generate and display a plurality of graphical representations of control 
panels for different devices based on said stored graphical interfaces of the devices, and that 
wherein the system further comprises: 

means (^ for identifying which of the stored control panels to be displayed. 
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6. (currently amended) A The system according to claim 5, charact e riz e d in that wherein 
said means for identifying which of the stored control panels to be displayed comprises a 
recognition unit (34) for recognizing and identifying devices in the environment of the user, and 
^iat wherein the system is adapted to determine which of the stored control panels to be 
displayed based on which of the devices is identified. 

7. (currently amended) A The system according to claim 6. charact e rized in that wherein 
said recognition unit (34) is adapted to recognize and identify unique identification markings (9% 
9^ on the devices (11a, lib) . 

8. (currently amended) A The system according to any of the claims 5 7. charact e riz e d 
in that claim 5, wherein the system is arranged so that it changes the virtual control panel 
displayed when another device is recognized and identified, and when the user has accepted the 
device. 

9. (currently amended) A The system according to any of th e pr e vious claim s , 
charact e riz e d in that claim 1 . wherein said portable identification element (3) is adapted to be 
carried by the user during interaction with the virtual control panel. 

1 0. (currently amended) A The system according to any of th e pr e vious claims, 
characteriz e d in that claim 1 . wherein said portable identification element (3) is attachable to the 
body of the user. 
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11. (currently amended) A The system according to any of th e previous claims, 
charact e riz e d in that claim 1 , wherein said display unit comprises a wearable display device (7) 
showing the user said view. 

12. (currently amended) A method that enables a user to interact with a virtual control 
panel using a user controlled pointing object, wherein the method comprise s comprising : 

receiving data representing the position of the user controlled pointing object (i), 
receiving data representing the position of a portable identification element 
storing at least one pre-defined graphical interface representing a control panel of a 

device, 

generating a graphical representation of the control panel of the device based on said pre- 
defined graphical interface, 

registering said graphical representation of the control panel in a fixed relation to said 
portable identification element, based on said data representing the position of the identification 
element, to produce a virtual control panel, 

displaying a view comprising the real world and the virtual control panel projected in a 
fixed relation to said portable identification element, and 

performing actions in response to the users interactions with the virtual control panel, 
wherein the actions to be performed is determined based on the position of said user controlled 
pointing object in relation to the position of the virtual control panel. 

13. (currently amended) A The method according to claim 12. further comprising: 
modifying the appearance of the virtual control panel in response to interactions between 
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the user controlled pointing object and the virtual control panel. 

14. (currently amended) A The method according to claim 12 , further comprising: or 13, 
vvhoroin it comprisoG, 

defining a two-way communication between the virtual control panel and the device, 
sending information to the device regarding the users actions with the virtual control 

panel, 

receiving data from the device, generating a graphical representation of the received data 

and 

displaying the data on the virtual control panel. 

15. (currently amended) A The method according to claim 14, wherein said data is 
displayed on the virtual control panel in response to interactions between the user controlled 
pointing object and the virtual control panel. 

1 6. (currently amended) A The method according to any of th e claims 12 15 claim 12 , 
wher e in th e m e thod compris e s further comprising : 

storing a plurality of pre-defined graphical interfaces, each representing a control panel of 

a particular device, 

determining which of the stored control panels to be displayed, and 

generating a graphical representation of the control panel to be displayed based on the 

pre-defined graphical interface of the control panel to be displayed. 
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1 7. (currently amended) A The method according to any of th e claims 12 16 claim 12. 
wherein at least one of the stored graphical interfaces comprises more than one graphical view to 
be displayed on the virtual control panel, and which of the views to be displayed is determined 
based upon the users actions. 

18. (currently amended) A The method according to claim 1 6. wh e r e in it compris e s 
further comprising: 

recognizing and identifying a device, 

determining which of the stored control panels to be displayed based on the identified 
device, and 

generating graphical representation of the control panel of the identified device based on 
the stored graphical interface of the identified device and displaying a view comprising the real 
world and the virtual control panel of the identified device projected in a fixed relation to said 
portable identification element. 

19. (currently amended) A The method according to claim 1 8 , wherein characterized in 
that each device is provided with a unique identification marking and a device is recognized by 
identifying its unique identification marking. 

20. (currently amended) A The method according to any of the claims 1 8 19 claim 18. 
wherein the virtual control panel displayed is changed when another device is recognized and 
identified, and when the user has accepted the device. 
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21. (currently amended) A The method according to any of th e claims 12 20 claim 12. 
wherein said portable identification element is carried by the user during interaction with the 
virtual control panel. 

22. (currently amended) A The method according to any of the claims 12 21 claim 12. 
wherein the virtual control panel comprises virtual interaction members and an audio and/or 
visual feedback is generated when the user activates any of the virtual interaction members. 

23. (currently amended) A computer program product, comprisingi 
a computer readable medium: and 

program instructions recorded on the computer readable medium which, when loaded 
into a computer, causes the computer to perform th e proc e ss of any of th e claim s 12 - 22 the steps 
of 

receiving data representing the position of the user controlled pointing object, 
receiving data representing the position of a portable identification element, 
storing at least one pre-defined graphical interface representing a control panel of a 

device. 

generating a graphical representation of the control panel of the device based on said pre- 
defined graphical interface. 

registering said graphical representation of the control panel in a fixed relation to said 
portable identification element, based on said data representing the position of the identification 
element, to produce a virtual control panel. 

displaying a view comprising the real world and the virtual control panel projected in a 
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fixed relation to said portable identification element, and 

performing actions in response to the users interactions with the virtual control panel, 
wherein the actions to be performed is determined based on the position of said user controlled 
pointing object in relation to the position of the virtual control panel . 

24. (cancelled) 
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